Controlled Lagrangians and Potential Shaping for 
Stabilization of Discrete Mechanical Systems 
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Abstract — The method of controlled Lagrangians for discrete 
mechanical systems is extended to include potential shaping in 
order to achieve complete state-space asymptotic stabilization. 
New terms in the controlled shape equation that are necessary 
for matching in the discrete context are introduced. The theory 
is illustrated with the problem of stabilization of the cart- 
pendulum system on an incline. We also discuss digital and 
model predictive control. 

I. Introduction 

The method of controlled Lagrangians for stabilization 
of relative equilibria (steady state motions) originated in 
Bloch, Leonard, and Marsden [4] and was then developed in 
Auckly [1], Bloch, Leonard, and Marsden [5], [6], [7], Bloch, 
Chang, Leonard, and Marsden [8], and Hamberg [11], [12]. 
A similar approach for Hamiltonian controlled systems was 
introduced and further studied in the work of Blankenstein, 
Ortega, van der Schaft, Maschke, Spong, and their collabora- 
tors (see, e.g., [18] and related references). The two methods 
were shown to be equivalent in [9] and a nonholonomic 
version was developed in [20], [21], and [2]. 

According to the method of controlled Lagrangians, the 
original controlled system is represented as a new, un- 
controlled Lagrangian system for a controlled Lagrangian, 
a modification of the original Lagrangian. The controlled 
Lagrangian is designed so that its associated energy has 
a maximum or minimum at the (relative) equilibrium to 
be stabilized. The time-invariant feedback control law is 
obtained by requiring that the new and old systems of 
equations of motion are equivalent. To obtain asymptotic 
stabilization, dissipation-emulating terms are added to the 
control input. 

The method of controlled Lagrangians for discrete me- 
chanical systems was introduced in Bloch, Leok, Marsden, 
and Zenkov [3]. In the present paper this formalism is further 
developed to include potential shaping which is used for 
complete state-space stabilization of equilibria. This study is 
motivated by the recent development of structure-preserving 
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algorithms for numerical simulation of controlled systems. 
In particular, as the closed loop dynamics of a controlled 
Lagrangian system is itself Lagrangian, it is natural to 
adopt a variational discretization that exhibits good long-time 
numerical stability. 

We carry out the matching procedure explicitly for discrete 
systems with two degrees of freedom and prove that we 
can asymptotically stabilize the equilibria of interest. The 
theoretical analysis is validated by simulating the discrete 
cart-pendulum system on an incline. When dissipation is 
added, the inverted pendulum configuration is asymptotically 
stabilized, as predicted. We then use the discrete controlled 
dynamics to construct a real-time model predictive controller 
with piecewise constant control inputs. This serves to illus- 
trate how discrete mechanics can be naturally applied to yield 
digital controllers for mechanical systems. 

The paper is organized as follows: In Sections Hll and Hill 
we review discrete mechanics and the method of controlled 
Lagrangians for stabilization of equilibria of mechanical sys- 
tems. The discrete version of the potential shaping procedure 
and related stability analysis are discussed in Sections IIVI 
and |y] The theory is illustrated with the discrete cart- 
pendulum system. Simulations and the construction of the 
digital controller are presented in Sections IVll and IVllI 

In a future publication we intend to treat discrete systems 
with nonabelian symmetries as well as systems with non- 
holonomic constraints. 

II. An Overview of Discrete Mechanics 

A discrete analogue of Lagrangian mechanics can be 
obtained by considering a discretization of the Hamilton 
principle; this approach underlies the construction of varia- 
tional integrators. See Marsden and West [17], and references 
therein, for a more detailed discussion of discrete mechanics. 

A key notion is that of the discrete Lagrangian, which is 
a map L'' : Q x Q ^ M that approximates the action integral 
along an exact solution of the Euler-Lagrange equations 



joining the configurations qk,qk+i £ Q, 

L'\qk,qk+i)~ ext / L{q,q)dt, (1) 
qeCi[o,h],Q)Jo 

where C([0, h], Q) is the space of curves q : [Q, h] Q with 
g(0) = qk, q{h) = qk+i, and cxt denotes extremum. 

In the discrete setting, the action integral of Lagrangian 
mechanics is replaced by an action sum 

N-l 

5"^(go,gi, . . . ,g7v) = ^ L'^{qk,qk+i), 

k=0 

where qk € Q, k — 0,1,..., N, is a finite sequence in 
the configuration space. The equations are obtained by the 
discrete Hamilton principle, which extremizes the discrete 
action given fixed endpoints qo and q^. Taking the extremum 
over qi, . . . , q^-i gives the discrete Euler-Lag range equa- 
tions 

DiL'-iqk, qu+i) + D2L\qk-i,qk) = 0, 

for fc = l,...,iV— 1. This implicitly defines the update map 
^tQxQ^QxQ, where <^{qk-i,qk) = {qk,qk+i) and 
QxQ replaces the phase space TQ of Lagrangian mechanics. 

Since we are concerned with control, we need to consider 
the effect of external forces on Lagrangian systems. In the 
context of discrete mechanics, this is addressed by introduc- 
ing the discrete Lagrange-d' Alembert principle (see Kane, 
Marsden, Ortiz, and West [14]), which states that 

n— 1 n— 1 

5^L'^ {qk, qk+i) + ^F'^ i<lk, qk+i) ■ {Sqk, Sqk+i) = 

fc=0 k=Q 

for all variations 6q of q that vanish at the endpoints. 
Here, q denotes the vector of positions (go, 91, • • ■ , 9^), 
and Sq = {Sqo,Sqi, . . . ,SqN), where Sqk £ Tg^Q- The 
discrete one-form F"^ on Q x Q approximates the impulse 
integral between the points qk and qk+i, just as the discrete 
Lagrangian L*^ approximates the action integral. We define 
the maps F^ , F^ : Q x Q —f T*Q by the relations 

F^{qo,qi)Sqi -.^ F" {qo, qi) ■ {0, Sq,) , 
Ft{qo,qi)Sqo := F^ {q^, q,) ■ {Sqo,0) . 

The discrete Lagrange-d' Alembert principle may then be 
rewritten as 

Tl-l 

Sj^^'^ (9fc,gfc+i) 

A:=0 
n-1 

+ Sqk + {qk,qk+l) Sqk+i] = 

fc=0 

for all variations 5q of q that vanish at the endpoints. This is 
equivalent to the forced discrete Euler-Lagrange equations 

DiL"" {qk,qk+l) + {qk-i,qk) 

+ Ft {qk,qk+i) + Fi {qk-i,qk) ^ 0. 



III. Matching and Controlled Lagrangians 

In the controlled Lagrangian approach, one considers a 
mechanical system with an uncontrolled (free) Lagrangian 
equal to kinetic energy minus potential energy. In the sim- 
plest setting, we modify the kinetic energy to produce a new 
controlled Lagrangian which describes the dynamics of the 
controlled closed-loop system. The method is extended by 
the incorporation of potential shaping in [8]. 

Suppose our system has configuration space Q and a Lie 
group G acts freely and properly on Q. It is useful to keep in 
mind the case in which Q = SxG with G acting only on the 
second factor by the left group multiplication. For example, 
for the inverted planar pendulum on a cart, Q = xM. with 
G — R, the group of reals under addition (corresponding to 
translations of the cart). 

Our goal is to control the variables lying in the shape 
space Q/G using controls that act directly on the variables 
lying in G.' For kinetic shaping, the controlled Lagrangian 
is constructed to be G-invariant, thus providing modified or 
controlled conservation laws. In this paper, we assume that 
G is an abelian group. 

The key modification of the Lagrangian involves changing 
the kinetic energy metric g{-,-). The tangent space to Q can 
be split into a sum of horizontal and vertical parts defined as 
follows: For each tangent vector Vq to Q at a point q E Q,we 
can write a unique decomposition Vg — Hor Vq + Ver Vq , such 
that the vertical part is tangent to the orbits of the G-action 
and the horizontal part is metric-orthogonal to the vertical 
space, i.e., it is uniquely defined by the identity 

g{Vq,Wq) ^ g{}iOTVq,}iOTWq) + g{YeT Vq,YeT Wq) (2) 

with Vq and Wq arbitrary tangent vectors to Q at the point 
q E Q. This choice of horizontal space coincides with 
that given by the mechanical connection; see, for example, 
Marsden [15]. 

For the kinetic energy of our controlled Lagrangian, we 
use a modified version of the right-hand side of equation OJ. 
The potential energy remains unchanged. The modification 
consists of three ingredients: 

1) a new choice of horizontal space, denoted Hoiv, 

2) a change g g^ of the metric on horizontal vectors, 

3) a change g gp of the metric on vertical vectors. 

Let denote the infinitesimal generator corresponding to 
f e 0, where g is the Lie algebra of G (see Marsden [15] 
or Marsden and Ratiu [16]). Thus, for each ^ G g, is a 
vector field on the configuration manifold Q and its value at 
a point q £ Q is denoted £,Q{q). 

Definition 1: Let t be a Lie-algebra-valued horizontal 
one-form on Q; that is, a one-form that annihilates vertical 
vectors. The T-horizontal space at q G Q consists of tangent 
vectors to Q at q of the form HorT-Wg := Hor Vq — [''"(w)]q (g), 
which also defines Vq ^ HoTrVq, the T-horizontal pro- 
jection. The T-vertical projection operator is defined by 

YeirVq := VeiVq + [T{v)]Q{q). 

'The shape space is S in the case Q = S X G. 



Definition 2: Given , gp, and t, the associated con- 
trolled Lagrangian Lr,a,p is given by a modified kinetic 
minus the given potential energy, namely 



9 



+ gp(Ver^Wq, Ver^Uq)] - V{q). 

The equations corresponding to this Lagrangian will be 
our closed-loop equations. The new terms appearing in those 
equations corresponding to the directly controlled variables 
are interpreted as control inputs. The modifications to the 
Lagrangian are chosen so that no new terms appear in the 
equations corresponding to the variables that are not directly 
controlled. We refer to this process as matching. 

Once the form of the control law is derived using the 
controlled Lagrangian, the closed-loop stability of an equi- 
librium can be determined by energy methods, using any 
available freedom in the choice of r, g^ and gp. 

We can extend the method of controlled Lagrangians to the 
class of Lagrangian mechanical systems with potential en- 
ergy that may break symmetry, i.e., we still have a symmetry 
group G for the kinetic energy of the system but we now have 
a potential energy V{x°'t6"-) that need not be G-invariant 
(see [8]). Further, we consider a modification to the potential 
energy that also breaks symmetry in the group variables. Let 
the potential energy for the controlled Lagrangian be defined 
as 

where is the modification — to be determined — that de- 
pends on a new real parameter e. 

For many systems it is sufficient to use the so-called 
simplified matching conditions [8]. For potential shaping in 
the setting where the simplified matching conditions hold we 
take gp — pgab where p is a scalar constant. The controlled 
Lagrangian takes the form 



where 



This has sufficient generality to handle many examples of 
interest. 

A basic example treated in earlier papers in the smooth 
setting is the pendulum on a cart. Let s denote the position 
of the cart on the s-axis, denote the angle of the pendulum 
with the upright vertical, and i/i denote the elevation angle of 
the incline, as in Figure Q The configuration space for this 
system is Q = S" x G = S"^ x M, with the first factor being 
the pendulum angle and the second factor being the cart 
position s. The velocity phase space, TQ, has coordinates 
((/), s, 0, s). The length of the pendulum is I, the mass of the 
pendulum is m and that of the cart is M. 

The symmetry group G of the kinetic energy of the 
pendulum-cart system is that of translation in the s variable, 
so G = M. 



M 



Fig. 1. The pendulum on a call going down an inclined plane under 
gravity. The control force is in the direction s, the overall motion of the 
cart. 



IV. Discrete Potential Shaping 

For simplicity, we consider systems with one shape and 
one group degree of freedom. We further assume that 
the configuration space Q is the direct product of a one- 
dimensional shape space S and a one-dimensional Lie group 
G. The continuous-time Lagrangian L : TQ R and the 
form T are 

L((/.,s,0,s) = ^{a<j,^+2p{(l))^s+js^)-V,{(t>)-V2{s) (3) 
and 



fc((/))0 with k{(f>) 



m 

(77 



This Lagrangian O) satisfies the simplified matching con- 
ditions of [8]. 

The continuous-time controlled Lagrangian Lr.a,p,e ■ 
TQ becomes 

■^T,o-,p,e(0, s, 0, s) = L{(j), s, 0, s + k{4))(l)) + \a^{k{(j))(l)f 

+ i{p- i)7(s + {<y- ^)Km^ + ^2(5) - VM. (4) 



where 



1/1 p- 1 



P 



1 \f 



(3{z) dz, 



the function Ve{y) is arbitrary, and {(j>e, Se) is the equilibrium 
of interest. As in Bloch, Chang, Leonard, and Marsden [8], 
the kinetic energies in Ot and i~4\ are G-invariant. 

For the cart-pendulum system, a, f3{4>), 7, Vi((j)), and 
¥2(3) are a — mP, (3{(l)) = to^cos(0 — -0), 7 = M + m, 
14(0) — ~mgl cos (p, and ¥2(3) = —7175 sin -0. Note that 
a-f-l3^{(j>) > 0. 

In discretizing the method of controlled Lagrangians, we 
combine formulae (TTl . (TSt . and (TH . In the rest of this paper, 
we will adopt the notations 



9fc+l/2 



Qk + Qk+l 



Ik+l — <lk- 



This allows us to construct a second-order accurate discrete 
Lagrangian and discrete controlled Lagrangian as 



Li 



Mk,qk+l) = hLr,cr,p,eiqk+l/2,^qk/h), (5) 



T,a,p,e V 

with qk ^{4>k-,Sk). 

The discrete dynamics is governed by the equations 

dL'^{qk,qk+i) , dL'^{qk-i, qk) 



= 0, 



dL'^{qk,qk+i) , dL'^{qk-i,qk) 



= Uk, 



(6) 
(7) 



dsk dsk 
where Uk is the control input. 

The dynamics associated with ( TSl is amended by the term 
Wk in the discrete shape equation: 



dL 



T,(T,p,€ 



{qk,qk^ 



9Li,„,p,^iqk-i,qk) 



dLi^„^p^,iqk,qk+i) 



d(j)k 



Wk, 



dL 



{qk-i,qk) 



= 0. 



(8) 



(9) 



dsk dsk 
This term Wk is important for matching systems ( TSt . ( TTl 
and ( TSt . ( TQI . The presence of the terms Wk represents an 
interesting (but manageable) departure from the continuous 
theory. Let 

Jfe = p-f{Ask/h -{a- l)ki(j)^^i)A(t)k/h). 

The following statement is proved by a straightforward 
calculation: 

Theorem 3: The dynamics ( TSl , ( TTl /s equivalent to the 
dynamics ( TSt , ;/ awt/ onfy ;/ Ufe an^^ Wfe ore g/ven Z^y 



v;'(,Sfe+i) + K'(s,_.) 



^ [Vei-'-fe+i; y^y^k- 
jA(l)kk{(pk+i/2) - lA(l)k-ik{(l)k-i/2) 



(10) 



and 



1 - + ^) (fc('^fe+i) [ - IpJk + ^vlivk+i) 



k( 



IpLk-i + ^V^iVk-i) 



- fc'((/)fc+i)JfcA0fe - k'{(l),,_i)Jk-iA(f)k-iy 

Remark. The terms Wk vanish when /?((/)) = const as they 
become proportional to the left-hand side of equation ( T^ . 

V. Stabilization of the Discrete Controlled 
System 

The stability analysis in this paper is done by means of an 
analysis of the spectrum of the linearized discrete equations. 
We assume that the equilibrium to be stabilized is {(pk, Sk) = 
(0,0). 

Theorem 4: The equilibrium {(j)k,Sk) = (0,0) of equa- 
tions O} '^fid '■s spectrally stable if 



a7-/32(0) 



<cr<0, p<0, and V;"(0) < 0. (11) 



Proof: The linearized discrete equations are 

^^T,<T,p,e(9fe:9fc+l) , 9L^,<T,p,e{%-l>%) 



OCpk OCpk 

dCi^^^p^,iqk,qk+i) , dCi^„^p^,{qk-^i,qk) 



dsk 



dsk 



= 0, (12) 



0, (13) 



where C'^^^p^^{qk,qk+i) is the quadratic approximation of 
Lf ^ p ^ at the equilibrium (i.e., /3(0), Vi (</>), and K(j/) in 
Li^^^p^^ are replaced by /?(0), lV{'{0)(f>^, and iy/'(0)2/2, 
respectively). Note the absence of the term Wk in equa- 
tion 

The linearized dynamics preserves the quadratic approxi- 
mation of the discrete energy 



aja^ - /3(0)2(cr - l)(p(cr - 1) - cr) 



/3(0)p(a-l) 



ah 
h 



IP 
2h 



2^i"(O)0ti + ^K'(OK+i, (14) 



where 



p-1 _ 1 \ m 



Since V\"(0) is negative, the equilibrium {(t)k,Sk) — (0,0) 
of equations (I 12> and ( I 13> is stable if the function i 14> 
is negative-definite. The latter requirement is equivalent to 
conditions i 11> . The spectrum of the linearized discrete 
dynamics in this case belongs to the unit circle. ■ 

Remarks. Spectral stability in this situation is not suffi- 
cient to conclude nonlinear stability. The stability conditions 
(I 11> are identical to the stability conditions of the corre- 
sponding continuous-time system. 

Following [8], we now modify the control input (^TOJl by 
adding the discrete dissipation-emulating term 

DjAyk^i + Ayk) ^^^^ 
h 

in order to achieve the asymptotic stabilization of the equi- 
librium {(pk, Sk) = (0, 0). In the above, I? is a constant. The 
linearized discrete dynamics becomes 

C>^i.,a,p,ei^k,qk+l) dLf,^p^^{qk^i,qk) 



dcpk 

p-l _ l\ m D{^Xk-i + Axk) 
a 



"•^r,g-,p,e 



P 

{qk,qk+i 



7 n. 

d^i.a.n.eiqk-l,qk) 



dsk 



dsk 

D{Axk-i+Axk) 
h 



(16) 



(17) 



Theorem 5: The equilibrium {4ik,Sk) — (0,0) of equa- 
tions and is asymptotically stable if conditions 
(I in are satisfied and D is positive. 

Proof: Multiplying equations ( I 16> and ( I 17> by 
(A0fc_i + A(j)k)/2 and {Ask-i + Ask)/2, respectively, we 



obtain 



Ek 



k,k+l 



Dh 



Axk- 



Axk 



where Ek,k+i is the quadratic approximation of the discrete 
energy i 14> . Recall that Ek,k+i is negative-definite. It is 
possible to show that, in some neighborhood of {(j)k,Sk) = 
(0,0), the quantity Ax^-i + Axk ^ along a solution 
of equations i 16\ and i 17> unless this solution is the 
equilibrium {(pk^Sk) = (0,0). Therefore, E^.k+i increases 
along non-equilibrium solutions of ( I 16> and (I 17> . Since 
equations (I 16> and (I 17> are linear, this is only possible if 
the spectrum of (I 16> and ( I 17> is inside the open unit disk, 
which implies asymptotic stability of the equilibrium of both 
linear system ( I 16> and ( I 17> and nonlinear system (TSl and 
(TTt with discrete dissipation-emulating term ( I 15> added to 



Mfc- 



VI. Simulations 



Simulating the discrete behavior of the controlled Lagran- 
gian system involves viewing equations ( TSt and ( T^ as an 
implict update map $ : {qk-2,qk-i) ^ {qk-i,qk)- This 
presupposes that the initial conditions are given in the form 
{qo,qi)', however it is generally preferable to specify the 
initial conditions as (qo,9o)- This is achieved by solving the 
boundary condition 



dL . 

^(90, go) 



DiL\qo,qi) + F^{qo,qi)^0 



for qi. Once the initial conditions are expressed in the form 
{qo,qi), the discrete evolution can be obtained using the 
implicit update map $. 

In FigureQ we present a MATLAB simulation of discrete 
controlled dynamics of the cart-pendulum system in the 
absence of dissipation. 



Here, h = 0.05 sec, to = G.14kg, M = 0.44kg, I = 
0.215 m, and t/j — -I radians. Our goal is to regulate the cart 
at s = and the pendulum at = 0. The control gains 
are chosen to be k = 20, p = -0.02, and e = 0.00001. 
It is worth noting that the discrete dynamics remain bounded 
near the desired equilibrium, and this behavior persists even 
for significantly longer simulation runs involving 10^ time- 
steps. The exceptional stability of the discrete controlled 
trajectory can presumably be understood in terms of the 
bounded energy oscillations characteristic of symplectic and 
variational integrators. 

When dissipation is added, we obtain an asymptotically 
stabilizing control law, as illustrated in Figure Q This is 
consistent with the stability analysis of Section fVl 




Fig. 3. Discrete controlled dynamics with dissipation. Here the oscillations 
die out and the cart converges to the desired point s = 0. 




2000 4000 6000 8000 10000 
t[sl 





2000 4000 6000 8000 10000 
t[sl 



□ 




s [m] 



Fig. 2. Discrete controlled dynamics without dissipation. The discrete 
controlled system stabilizes the motion about the equilibrium; since there 
is no dissipation, the oscillations are sustained. 



VII. Model Predictive Controller 

We now explore the use of the forced discrete Euler- 
Lagrange equations as the model in a real-time model 
predictive controller, with piecewise constant control forces. 
Algorithm 1 below describes the details of the procedure. 

The digital controller uses the position information it 
senses for t = —2h, —h to estimate the positions at t = 0,h 
during the time interval t = [— /i, 0]. This allows it to 
compute a symmetric finite difference approximation to the 
continuous control force u{(j>,s,4>,s) at t — h/2 using the 
approximation 



Ul/2 



So + Si 



oo Si - So 



where the overbar indicates that the position variable is 
being estimated by the numerical model. This control is then 
applied as a constant control input for the time interval [0,h]. 
This algorithm can be implemented in real-time if the two 
forward solves can be computed within the time interval h. 

The initialization of the discrete controller is somewhat 
involved, since the system is unforced during the time 



Algorithm 1. DIGITAL CONTROLLER ( q{-),Tf,h ) 

qo <— sense q{0) 
qi ^ sense q{h) 

q2 ^ solve D2L'^iqo,qi) + DiL'^{qi,q2) = 
q3^SOlyeD2L''iqi,q2)+DiL'i{q2,q3)+Ff{q2,q3)^0 

"2+1/2 <- U [^—, — ft— j 

actuate u = M2+1/2 for t G [2/i, 3ft.] 

92 ^ sense q{2h) 

93 ^ solve D2L'^iqi,q2) + DiL'^{q2,q3)+Ff{q2,q3)^0 
qi solve D2L'^{q2, 93) + DiL'^{q3, 94) 

+F2''fe,g3) + ^^{'(93,g4) = 

"3+1/2 ^ " ' — ft— j 

actuate u = W3+1/2 for t £ [3h, 4ft.] 
for A; = 4 to (Ty/ft- 1) do 
gfc_i ^ sense q{{k - l)ft) 

gfe <- solve D2L'^{qk-2,qk-i) + DiL'^{qk-i,qk) 

+F^{qk-2,qk-l) + F^{qk^i,qk) = 

gfe+i ^ solve D2L'^{qk-i,qk) + DiL'^{qk,qk+i) 

+F.^iqk-i,qk) + Ff{qk,qk+l)^0 

w/c+1/2 ^ w 1^ 2 ' ft J 

actuate u = Uk+1/2 for t G [kh, [k + l)ft] 
end for 



interval [0,2ft] while the controller senses the initial states, 
and computes the appropriate control forces. 

The numerical simulation of the digital controller is shown 
in Figure H We see that the system is asymptotically stabi- 
lized in both the and s variables. 




-0.02' ' • ' ' 1 -0.5 1 ' ' ' ' 1 

-0.4 -0.2 0.2 0.4 0.6 1 2 3 4 5 

tj) [rad] s [m] 



Fig. 4. Tlie discrete real-time piecewise constant model predictive 
controller stabilizes <f> and s to zero. 

VIII. Conclusions 

In this paper we have introduced potential shaping tech- 
niques for discrete systems and have shown that these lead 
to an effective numerical implementation for stabilization in 
the case of the discrete cart-pendulum model. The method in 



this paper is related to other discrete methods in control that 
have a long history; recent papers that use discrete mechanics 
in the context of optimal control and celestial navigation 
are [10], [13], and [19]. The full theory of discrete controlled 
Lagrangians will be developed in a forthcoming paper. 
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